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ABSTRACT 



J. Vella, P, Berardinelli , and J, Burrow (1998) described 
the "accountability process" of program evaluation. This process was 
implemented to evaluate a Parents as Teachers program after a year of 
operation. Evaluation included determining goals, identifying objectives, and 
determining the focus. Critical elements were identified for educational 
outcomes, as were key stakeholders' needs and priorities. Learning tasks and 
materials, expected outcomes, evidence of change, and documentation were 
identified, and the evidence was analyzed. For the educational process, 
elements to evaluate and learning tasks and materials were determined. 
Expected outcomes and evidence of change were identified. Data gathering 
procedures were developed, and the evidence was analyzed. Existing program 
data were classified into six categories: (1) objectives and program content; 

(2) learning tasks and materials; (3) anticipated changes in learning; (4) 
evidence of change; (5) documentation of evidence; and (6) analysis of 
evidence. Results, which show the effectiveness of the program to the various 
stakeholders, will be used as baseline data for a longitudinal study of 
program effectiveness. The six data classifications are presented as a chart, 
and four forms used in the evaluation are attached. (SLD) 
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Planning the evaluation component during program development is optimal but not always 
realistic. Evaluating existing programs requires “backing into evaluation”. Founded in Baldwin and 
Ford’s work on transfer and impact of professional training programs and Berardinelli and Burrow’s 
accountability process Vella, Berardinelli, and Burrow (1998) described the accountability process of 
program evaluation. 

The accountability process was implemented to evaluate a Parents as Teachers program after one 
year. Evaluation included determining goals, identifying objectives, and determining the focus (a 
combination of educational outcomes and educational process). 

For educational outcomes, critical elements were identified, key stakeholders’ needs and 
priorities were identified, learning tasks/materials were identified, expected outcomes were identified, 
evidence of change and documentation were identified, and analysis of evidence was dete rmin ed. 

For the educational process, elements to evaluate and learning tasks/materials were dete rmin ed, 
expected outcomes and evidence of change were identified, data ^thering procedures developed, and 
analysis of evidence determined. 

Existing program data were put in one of six columns: Objectives and program content; learning 
tasks/materials; changes in learning, transfer and impact; evidence of change; and documentation of 
evidence. The researcher filled in analysis of data. Existing data determined program effectiveness 
except for a few circumstances. A telephone survey gathered data not found elsewhere. 
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Results showed school district, stute departnient of education, legislators, and other key 
stakeholders the effectiveness of the Parents as Teachers program. Even though limitations exist when 
fitting an evaluation plan into an existing program, a few modifications can often allow the data for 
missing outcomes and process elements to be gathered. The comprehensive nature of the accountability 
process functioned as a template laid over the program. Under developed elements readily emerged, 
indicating areas for redesign. Evaluation results will be used as base line data for a longitudinal study of 
program effectiveness. 
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Monthly Home Visitor Report-Form 577 Supplement 
Parents as Teachers Program Evaluation 



Family Number/Name Date 

For Previous Month’s PAT Task Sheet Activity (#/description) 

[PE asks M to rate] 

1 . How many times did you complete the PAT Task Sheet Activity with your child this month? 

2. If you were to rate the success of the activity, would you rate it as 

1 2 3 4 5 

complete some minimal M did not C did not 

success success success initiate cooperate 

3. If you were to rate your confidence in completing the activity, would you rate it as 

1 2 3 4 5 

complete some minimal M did not C did not 

confidence confidence confidence initiate cooperate 



Report on homework activity [PE asks M to rate] 

4. How well did your child complete the activity? 

1 2 3 4 5 

completely somewhat minimal M did not C did not 

completed completed completion initiate cooperate 

5. If you were to rate the success of the homework activity, would you rate it as: 

1 2 3 4 5 

completely somewhat minimally M did not C did not 

successful successful successful initiate cooperate 

, I 

6. What good/positive things did you notice as you did the activity? How might doing the activity help 
your child later in school? Write response in space below. 



7. What concerns and challenges did you face as you did the activity? Write response in space 
below. 



8. How confident did you feel about doing the activity? 



1 


2 


3 


4 


5 


complete 


some 


minimal 


M did not 


C did not 


confidence 


confidence 


confidence 


initiate 


cooperate 
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9 . 



For Reading Activity-Itty Bitty Book Club [PE asks M] 

How many books did you read to your child this month? 



10. If you were to rate the success of the reading activity, would you rate it as: 

1 2 3 4 5 

completely somewhat minimally M did not C did not 

successful successful successful initiate cooperate 



1 1. What good/positive things did you notice as you read the book? How might reading books help your 
child later in school? Write response in space below. 



12. What concerns and challenges did you face as you read the books? Write response in space 
below. 



13. How confident did you feel about doing the activity? 

1 2 3 4 5 

complete some minimal M did not C did not 

confidence confidence confidence initiate cooperate 

14. Is there anything you’d like to share about your interactions with your child during the past month? 



For Present Month’s PAT Activity [PE rates M] • 

14. If you were to rate the success of this month’s activity, would you rate it as: 

1 2 3 4 5 

complete some minimal M did not C did not 

success success success initiate cooperate 

15. If you were to rate M’s confidence in completing the PAT Task Sheet given on this date, would you 
rate it as: 

1 2 3 4 5 

complete some minim al M did not C did not 

confidence confidence confidence initiate cooperate 
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Telephone Interview 
PAT Program Evaluation 

Implemented at 12, 24, 36 Month Points 

On a scale of 1-3 with 1 being very confident and 3 being not confident at all 

1. How confident do you feel discussing your child’s development with the parent educator? 

1 2 3 

Very confident fairly confident not confident at all 

2. How confident do you feel that you can find resources that will answer your questions about your 
child’s development? 

1 2 3 

Very confident fairly confident not confident at all 

3. How confident do you feel as a parent? 

1 2 3 

Very confident fairly confident not confident at all 

4. How important do you feel you are as your child’s first and foremost teacher? 

1 2 3 

Very important fairly important not important at all 

5. Which of these Petal Parenting Center events and activities did you attend? 

Day at the Beach 

Drop In 

Health Fair 

On a scale of 1 to 3 with 1 being very much and 3 being not at all, 

6. Did the events you attended provide you with support from other parents? 

1 2 3 

Very much somewhat not at all 

7. Were your questions about your child’s development answered by the PE, referral sources, group 
meetings and other PPC activities? 



Referral Suromary Sheet 
PAT Program Evaluation 



Number of Referrals made 
Total 

By each family 
By entire group 

Mean 

By entire group 



Follow-up 

M does not follow-up at all 

M follows up 1 time 

M follows-up until professional terminates 

M aborts follow-up after sessions 

Family Date Referral Appointments Termination 

Number Source By Professional By Parent 



Criteria: 

80% referrals are followed up by at least 1 appointment 
70% referrals are followed up until professional terminates 
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Group Meeting Evaluation 
Petal Parenting Center-Parents As Teachers Program 



Number present 

Characteristic # who shared information 

1 . Refer to previously learned 
milestones information 



2. Talk about milestones C 
accomplishes 

3. Share something about role 
as child’s first and foremost 
teacher 



4. Questions/more information about ideas discussed today: 
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